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1. TITLE OF THE INVENTION 

Apparatus of Digital Item Adaptation with Well-Described Terminal via UR 



2. WHAT IS CLAIMED IS: 

(l)Apparatus of Digital Item Adaptation with Well-Described Terminal, c 
omprising the following steps of: 

Building a terminal by selecting CPU, OS, Memory, power, VM (Virtual Mac 
hine) for its general property; 

Building a terminal by selecting Data I/O (data input and output), such 

as USB, Bluetooth, Wireless 802, Serial, Parallel, etc. 

Building a terminal by selecting Storage, such as MMC (Multimedia Card), 

CompactFlash, SD (Secure Disk), MS (Memory Stick), HD (Hard Disk), DVD, 

VCD, Zip Disk, or Floppy; 
Building a terminal by selecting Supporting Tools like GPS (Global Posit 
ioning System), Browser, IPMP (Intellectual Property Management and Prot 
ection) Tools, REL (Rights Expression Language) Tool, Metadata Tool; 
Building a terminal by conforming to certain AV Decoding format that is 
compliant to certain standard; 

Building a terminal by conforming to certain AV Encoding format that is 
compliant to certain standard; 

Building a terminal by conforming to certain image format supporting tha 
t is compliant to certain standard; 

Building a terminal by conforming to certain text format supporting that 

is compliant to certain standard; 
Building a terminal by conforming to certain System format supporting th 
at is compliant to certain standard; 

Building a terminal by providing certain Audio output for playing back a 
udio or voice; 
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Building a terminal by providing certain Audio input for accepting audio 
or voice; 

Building a terminal by providing certain Video output for displaying vid 
eo or image; 

Building a terminal by providing certain Video input for capturing video 
or image; 

Building a terminal by providing certain Text output for displaying text 

9 

Building a terminal by providing certain Text input for inputting text; 
Describing the said terminal using a tree-structure Descriptions to cove 
r the above terminal's characteristics and capability; 
Storing the said tree-structure Terminal Descriptions in certain URL; 
Negotiating the other party by pointing to URL for the said terminal des 
criptions before content delivery from the said other party, and 
Receiving the matched content from the said other party. 

(2) Apparatus of Digital Item Adaptation with Well-Described Terminal, co 
mprising the following steps of: 

Building a multimedia framework by converting content, to be prepared fo 
r supporting different terminals with different capabilities; 
Building a multimedia framework by implementing a negotiation protocol f 
or obtaining terminal descriptions; 

Building a multimedia framework by implementing a parser for parsing the 
said terminal descriptions obtained from URL which is pointed by the ne 
got i at ion message via the said negotiation protocol; 

Sending negotiation message to obtain the said terminal descriptions fro 
m the said URL; 

Parsing the obtained terminal descriptions; 

Selecting the content in the matched format and matched capability with 
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the said terminal according to the parsed terminal descriptions, and 
Delivering the said selected content to the said terminal. 

(3) Apparatus of Digital Item Adaptation with Well-Described Terminal, wh 
ereas Negotiating the other party by pointing to URL for the said termin 
al descriptions in claim 1 further comprising the following steps of: 
Pointing URL for retrieving different and selected branches of the said 
tree-structure of the said terminal descriptions for different applicati 
ons. 

(4) Apparatus of Digital Item Adaptation with Well-Described Terminal, w 
hereas Sending negotiation message to obtain the said terminal descripti 
ons from the said URL in claim 2 further comprising the following steps 
of: 

Sending negotiation message to obtain different and selected branches of 
the said tree-structure of the said terminal descriptions from the said 
URL for different applications 

(5) Apparatus of Digital Item Adaptation with Well-Described Terminal, wh 
ereas Building a terminal by conforming to certain AV Decoding format th 
at is compliant to certain standard in claim 1 further comprising the fo 
1 lowing steps of: 

Selecting Audio Decoding supporting format; 
Selecting Video Decoding supporting format; 
Determining Bit rate for Audio Decoding; 
Determining Bit rate for Video Decoding; 

Determining Maximum bit rate for Audio Decoding in the case of variable 
bit rate coding; 

Determining Maximum Bit rate for Video Decoding in the case of variable 
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bit rate coding; 

Determining Average bit rate for Audio Decoding in the case of variable 
bit rate coding; 

Determining Average Bit rate for Video Decoding in the case of variable 
bit rate coding, and 

Determining restricted Buffer Size for Audio or Video Decoding. 

(6) Apparatus of Digital Item Adaptation with Wei 1 -Described Terminal, wh 
ereas Building a terminal by conforming to certain AV Encoding format th 
at is compliant to certain standard in claim 1 further comprising the fo 
Honing steps of: 

Selecting Audio Encoding supporting format; 
Selecting Video Encoding supporting format; 
Determining Bit rate for Audio Encoding; 
Determining Bit rate for Video Encoding; 

Determining Maximum bit rate for Audio Encoding in the case of variable 
bit rate coding; 

Determining Maximum Bit rate for Video Encoding in the case of variable 
bit rate coding; 

Determining Average bit rate for Audio Encoding in the case of variable 
bit rate coding; 

Determining Average Bit rate for Video Encoding in the case of variable 
bit rate coding, and 

Determining restricted Buffer Size for Audio or Video Encoding. 

(7) Apparatus of Digital Item Adaptation with Well-Described Terminal, wh 
ereas Building a terminal by conforming to certain System format support 
ing that is compliant to certain standard in claim 1 further comprising 
the following steps of: 
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Selecting MPEG2 System format supporting; 
Selecting MPEG4 System format support ing^ 



Selecting certain file format supporting, and 
Selecting certain communication protocol supporting. 

(8) Apparatus of Digital Item Adaptation with Well-Described Terminal, wh 
ereas Selecting MPEG2 System format supporting in claim 7 further compri 
sing the following steps of: 

Determining MPEG2 Transport System (TS) format supporting, and 
Determining MPEG2 Program System (PS) format supporting. 

(9) Apparatus of Digital Item Adaptation with Well-Described Terminal,. wh 
ereas Selecting MPEG4 System format supporting in claim 7 further compri 
sing the following steps of: 

Determining MPEG4 system part 1 format supporting; 
Determining MPEG4 system part 11 format supporting; 
Determining MPEG4 system part 12 format supporting; <- 
Determining MPEG4 system part 12 format supporting; 
Determining MPEG4 system part 13 format supporting; 
Determining MPEG4 system part 14 format supporting; 
Determining MPEG4 system part 15 format supporting, and 
Determining MPEG4 system part 16 format supporting. 

(10) Apparatus of Digital Item Adaptation with Well-Described Terminal, w 
hereas Selecting certain file format supporting in claim 7 further compr 
ising the following steps of: 

Determining MP4 file format supporting; 
Determining QuickTime file format supporting; 
Determining AVi file format supporting; 
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Determining MP21 file format supporting; 
Determining ASF file format supporting; 

Determining other file formats which is used in other areas, and 
Determining future file formats. 

(11) Apparatus of Digital Item Adaptation with Well-Described Terminal, w 

hereas Selecting certain communication protocol supporting in claim 7 fu 

rther comprising the following steps of: 

Determining RTP protocol supporting; 

Determining H.323 protocol supporting; 

Determining SIP protocol supporting; 

Determining HTTP protocol supporting; 

Determining TCP/IP protocol supporting, and 

Determining other protocols supporting. 

3. DETAILED DESCRIPTION OF THE INVENTION 

3.1 Industrial Field of Utilization 

The present invention relates to Digital Item Adaptation where the capab 
ility of a well-described terminal can be fully understood and interpret 
ed by a server, gateway, or other peers, and relates to Digital Item Ada 
ptation where a well-described terminal can access multimedia content in 
different formats. 

3.2 Background and Prior Art 

MPEG and other standard bodies have created many standards in video, aud 
io, system, communication protocol, content representation, content pack 
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aging, etc.. 

As a result of it existing contents can be found in different formats du 
e to the different source coding methods, MPEG1, MPEG2, MPEG4, DV, DVCPR 
0, RTP, MP4, QuickTime, Avi, ASF, etc., and at the same time devices and 

terminals are also built in different scope to be compliant with certai 
n standard but not with another. For example, an existing DTV STB (Set-T 
op-Box) can decode and play back MPEG-2 system stream with MPEG-2 con ten 
t, but cannot play back DV or MPEG-4 content since the content packaging 

format here is different besides audio and video coding is different. 

Content can be easily converted from one format to the other including s 
ystem format and AV sourcing coding format, and service provider can pro 
vide content in different format. However a terminal only can support on 
e or some of the formats. 

It would be desirable that a terminal could be well described to reflect 
its capability, such as AV coding format, system supporting format, as 

well as its storage and Audio and video output supporting capability, so 
that the content can be delivered to the terminal in an appropriate for 

mat upon negotiation. 

The prior art is illustrated in Figure 1 and Figure 2 to state the curre 
nt situation where a content in certain data format cannot be played bac 
k by different terminals. 

In Figure 1, it is shown that MPEG-2 MP@ML content is delivered from Dev 
ice A in module 1.1 to user, and only terminal with DTV STB in module 1. 
4 can play back. The other terminals in module 1.2, 1.3, and 1.5 cannot 
play the content. 
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In Figure d, it is shown that MPEG-2 MPOML content is delivered from Mul 
timedia server in module 2.1 to user in interactive two-way, and only DT 
V STB in module 2.4 can play back. The other terminals in module 2.2, 2. 
3, and 2.5 cannot play the content. 

From the above examples it is understood that such situation limits the 
content accessibility by a broad range of terminals and network. 

On the other hand, it is not possible for terminal to be built to enable 
decoding all different formats of content, which is too much costly. 

This invention is focusing on defining terminal description with an orga 
nized structure, especially focusing on defining sub-element like system 
format and communication protocol. 

3.3 Problem to be Solved 

This invention is to try to solve the following problems: 

The same content can be accessed, retrieved and consumed by any well -des 
cribed terminal; 

A well-described terminal is able to access, retrieve, and consume any c 
ontent that is in different data formats. 

3.4 Means of Solving the Problems 

By defining a tree-structure description for a terminal, the terminal ca 
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pability can be described to reflect its AV and system coding capability 
, AV input/output capability, storage and data I/O capability, text mark 
-up language supporting, communication protocol, downloading capability, 
etc. 

By defining a tree-structure description for a terminal, the terminal ca 
n be described to reflect its processing power, memory, operating system 
, etc. Such description can be referred when certain software will be do 
wnloaded to the terminal. 

By defining a tree-structure description for a terminal with hierarchy s 
tructure, it is easy and efficient for a multimedia framework to conduct 
terminal capability negotiation just for some selected branches from th 
e tree-structure. 

By defining a tree-structure description for a terminal with an organize 
d structure, it is simple and easy for a terminal to fill-up the tree br 
anches that are corresponding to different categories for the terminal c 
apabilities. 

3.5 Operation of the Invention 

A terminal is well described in a tree-structure: 

In the fist layer, DeviceProperty, Codec, InputOutput are described. 

In the second layer: 

1) Under DeviceProperty: GeneraiProperty (CPU, OS (Operating System), Me 
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mory, Power, VM) , DatalO (Serial, Parallel, USB, InfraRed, BlueTooth, Wi 
reless802), Storage (MMC (Multimedia Card), SD (Secure Disk), MS (Memory 
Stick), HD (Hard Disk), DVD-RAM, CD-RW, Floppy, Zip Disk), SupportingTo 
ol (GPS (Global Positioning System), Browser, IPMPTool, RELTool, etc.) a 
re further described; 

2) Under Codec: AVDecoding (Audio, Video), AVEncoding (Audio, Video), Im 
ageFormat, TextFormat, SystemFormat (MPEG-2TS, MPEG-2PS, MPEG-4, MP4, AS 
F, Avi, QuickTime, RTP, H.323, etc.) are further described; 

3) Under InputOutput: AudioInOut (Speaker, Mic) , VideoInOut (Display, CC 
D), TextlnOut (Screen, PointingDevice, Keypad, Keyboard), are described 
in detail; 

The tree structure terminal description is stored in URL (Uniform Resour 
ce Locator). The negotiation messages can carry URL instead of the actua 
1 terminal descriptions either whole branch or sub-branches to conduct D 
igital Item Adaptation, which can save transmission bandwidth. In that c 
ase the actual terminal description can be obtained from the pointed URL 

• 

3.6 Embodiments 

Layer Structure of Terminal Capability description 
Layer 1 

Layer Structure: 

Layer 1 is the top level which consists of three groups: Deviceproperty 
3.1, Codec 3.2, InputOutput 3.3 , as shown in Figure 3 for its schema. 
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The Element Names and their Semantics for Layer 1 are defined in Table 1 



Table 1: Semantics for Terminal Capability Description for Layer 1 





Name 


Definition 


TerminalC i 
apability 


DeviceProperty 


Describe terminal's basic property, DatalO, 
Storage, and basic SupportinpiTool 


Codec 


Describe terminal's AV Coding capability, 
System Format supporting. 


InputOutput 


Describe terminal's multimedia input and 
output 


Extension 


for fiiture classes of extensions to capabilities 



Layer 2 

Layer 2 is to further describe the elements in the Layer 1 groups. 

Descriptions of the Elements under Terminal DeviceProperty: 

This layer contains GeneralProperty 4.1, DatalO 4.2, Storage 4.3, Suppor 
tingTool 4.4 as shown in Figure 4 for its schema. 

Layer Structure: 

The Element Name and their Semantics are defined in Table 2. 

Table 2: Semantics for Terminal Capability Description for Elements unde 
r DeviceProperty 
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Name of Upper 


Name 


Definition 


Layer 






DeviceProperty 


GeneralProperty 


Describe CPU, OS, Memory, Power, VM 


DatalO 


Describe Data I/O like Infrared, USB, 
Bluetooth, Serial, Parallel, Wireless 802. 




Storage 


Describe storage format supporting like 
MMC, SD, MS, HD, DVD, VCD, Zip, Floppy 




SupportingToal 


Describe terminal supporting tools like 
GPS, Browser, IPMPTool, EELTool, 
MetadataTool 




Extension 


for future classes of extensions to 
capabilities 



Descriptions of the Elements under Terminal Codec: 

This branch contains AVDecoding 5.1, AVEncoding 5.2, ImageFormat 5.3, Te 
xtFormat 5.4, SystemFormat 5.5 as shown in Figure 5 for its schema. 

Layer Structure: 

The Elements and their Semantics are defined in Table 3. 

Table 3: Semantics for Terminal Capability Description under Codec 
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Name of 

Upper 

Layer 


Name 


Definition 


Codec 


AVDecoding 


Describe Audio and Video decoding format 
supporting 


AVE needing 


Describe Audio and Video encoding format 
supporting 


ImageFormat 


Describe Image coding format supporting 


TfextFormat 


Describe Text format supporting 


SystemFormat 


Describe System format supporting 


Extension 


for future classes of extensions to capabilities 



Descriptions of the Elements under Terminal InputQutput: 

This branch contains AudioInputOutput 6.1, VideoInputOutput 6.2, Textlnp 
utOutput 6.3 as shown in Figure 6 for its schema. 

Layer Structure: 

The Elements and their Semantics are defined in Table 4. 

Table 4: Semantics for Terminal Capability Description under InputOutput 
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Name of 
Upper Layer 


Name ( 


Definition 


InputOutput 


AudioInOut 


Describe Audio input and output capability 
like Speaker, Mic 


VideoInOut 


Describe Video input and output capability 
like Display, CCD Camera 


TextlnOut 


Describe Text input and output capability like 
Screen, Pointing, KeyPad, Keyboard, Mouse 


Extension 


for future classes of extensions to capabilities 



The details for other elements like DeviceProperty and InputOutput will 
not be explained and defined here, but the detail descriptions for Codec 
element is further defined in next section. 

Description for Codec Element: 

This Codec element consists of AVDecoding, AVEncoding, ImageFormat, Text 
Format, and SystemFormat. 

AVDecoding is further shown in Figure 7 for its schema and its sub-eleme 
nts: 

The Element Names and their Semantics are defined in Table 5. 
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Table 5 : Semantics for Terminal AVDecoding Description 


Name 


Definition 


AVDecoding 


Tools for describing the decoding capabilities of a terminal. 


Format (7. 1) 


Describes Video/ Audio coding format 


Video (7.2) 


Describes decoding capabilities specific to video. 


Audio (7.3) 


. Describes decoding capabilities specific to audio. 



BitRateAudio (7.4) Indicates the nominal bit rate in bit/s (optional). 

BitRate Video (7.4) 

BufferSize (7.5) indicate the buffer size for Video/Audio coding; for example in AVC 

coding, it is highly preferred for a Hypothetical Reference Decoder (HRD) 
model to obtain the allocated Video Buffer Size in a video decoder for better 
video streaming performance. This Video/Audio BufferSize is not the same 
one as the conformed buffe r size to the profile/level. 



Extension J° r fixture classes of extensions to capabilities 



Three attributes exist under "BitRate 5 ' element of Audio/VidfiQ. 



Value Indicates the normal numerical value for the BitRate in case of 
constant bit rate (required) 

Maximum Indicates the maximum numerical value for the Bi tRat e in case of 
variable bit rate (optional), . 

Average Indicates the average numerical value for the BitRate in case of 
variable bit rate (optional). 

Descriptions of AVEncoding: 

This AVEncoding is the same as AVDecoding as shown in Figure 7 and Table 
5. 

Descriptions of ImageFormat: 

This is to describe Image coding format supporting by the terminal like 
JPEG, JPEG2000, Gif, Taga, BitMap, PNG, TIFF. 

Descriptions of TextFormat: 

This is to describe Text format supporting by the terminal like ASCII, S 
hiftJIS, HTML, XML, SMIL. 



Detail Descriptions of SystemFormat: 
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SystemFormat is shown in Figure 8 for its schema and its sub-elements: 
The Element Names and their Semantics are defined in Table 6. 



Table 6: Semantics for Terminal SystemFormat Description 



Name 






SystemFormat 


TVvVlc for rlf»cf»rJ fiincT tri<* cvctrai fewrwktxt cimnnrfino rvf* 9 tpmninnl 
X LMJio LU1 UwavillPJJJg IXLv ajrSvGUl Xviuu*t aUPiH/iUlfg MX, <* IwlllJlJiaJ. 


MPEG2 


IS 


Describes MJrJbviZ transport Muiu/de-muitipiex supporting 


(8.1) 


PS 


uescnues iviJr eajz rrogram iviLUU/Gc-muiupiex. supporting 


MPEG4 


Parti 


jjescnucs jvjjr___\j*f system ronnat suppoixiiig oasea. on xvLrnvj** ran i 


(8.2) 


Parti 1 


Describes JViJrJ__04 system iormat supporting based on MJr JbU4 ran 1 1 




Partl2 


Describes MPEG4 system format supporting based on MPEG4 Part 12 




Partl3 


Describes MPEG4 system format supporting based on MPEG4 Part 13 




Partl4 


Describes MPEG4 system format supporting based on MPEG4 Part 14 




PaitlS 


Describes MPEG4 system format supporting based on MPEG4 Part IS 




Partl6 


Describes MPEG4 system format supporting based on MPEG4 Part 16 


SystemFF 


MP4 


Describes MP4 file format supporting 


(8.3) 


QuickTime 


Describes Quicklime file format supporting . 




ASF 


Describes MicroSoft ASF format supporting 




MP2 


Describes MP2 file format supporting 




MP21 


Describes MP21 file format supporting 




AVi 


Describes Avi file format supporting 


Commumca 


RIP 


Describes RTF protocol supporting 


tionProtocol 


H.323 


Describes 11.323 protocol supporting 


(8.4) 


HTTP 


Describes HTTP protocol supporting 




TCP/IP 


Describes TCP/IP protocol supporting 




SIP 


Describes SIP protocol supporting 


Extension 




for future classes of extensions to capabilities 



3.7 Effects of Invention 



A terminal with a well-defined structured DIA descriptions is able to ac 
cess, retrieve, and consume any content in different formats, and it is 
able to use in different applications to expand its usefulness. 



A multimedia framework can use the terminal descriptions with the tree-s 
tructure to negotiate with the terminal before delivering content to the 
terminal, to better match with the terminal capability. 



A server or gateway built with the defined structured DIA descriptions i 
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s able to select adaptation tools to convert content from one into anoth 
er format, to match with the required format by a terminal, so that it c 
an serve for variety of terminals to expand its business scale. 



4. BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 shows the Prior Art 1- One-way Content Delivery to Users with D 
ifferent Types of Terminals 

Figure 2 shows Prior Art 2 - Two-way Content Retrieval and Accessing by 
Users with Different Types of Terminals 

Figure 3 shows the Schema and Syntax for the Top Level Structure of the 
Terminal Description 

Figure 4 shows the Schema and Syntax for DeviceProperty of the Terminal 
Description 

Figure 5 shows the Schema and Syntax for Codec of the Terminal Descripti 
on 

Figure 6 shows the Schema and Syntax for InputOutput of the Terminal Des 
cription 

Figure 7 shows the Schema and Syntax for AVDecoding of the Terminal Desc 
ription 



Figure 8 shows the Schema and Syntax for SystemFormat of the Terminal De 
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Device A 
(Contents stored in 
MPEG-2 MP@ML) 



Deliver 



Cannot 




play 








Cannot 




Dlav 






-> 


Okay 




Cannot 


-> 


play 





1.2 



Mobile Phone with 
MPEG-4 Simple 



PDA with 
MPEG-4 Core 



DTV STB with 
MPEG-2 MP@HL 



PCwithWMT 



1.3 



1.4 



1.5 



Figure 1: Prior Art 1- One-way Content Delivery to Users 
with Different Types of Terminals 



2.1 



Multimedia Server 
(Contents stored in 
MPEG-2 MP@ML) 



Can I play? 
TJo 



Can I play? 
"No 



Can I play? 
yes 



Can I play? 
< No 



2.1 



Mobile Phone with 
MPEG-4 Simple 



PDA with 
MPEG-4 Core / 



DTV STB with 
MPEG-2 MP@HL 



2.2 
2.3 



PCwithWMT 



r 



Figure 2: Prior Art 2 - Two-way Content Retrieval and 
Accessing by Users with Different Types of Terminals 
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<complexType name= n TermlnalCapabnitiesType ,, > 

<sequence> _ . _ 

<element name= ,, DeviceProperly ,, type=» ,, DevicePropertyType ,, minOccurs="Cr/> 
Olement name^Codec" type="CodecCapabiBtiesType" min0ccurs= M 07> 
<©Jement name^lnputOutput" type^lnputOutputCapabilttiesType" minOccurs= w 0°/> 
</sequence> 
</comp!exType> 

Figure 3: Layer 1 Structure of Terminal Capability 




<complexType name= rt OevlcePropertyType a >. 
<sec|uonce> 

<etementnarne="GeneralProperty d m}n0ccurs="07> 
<©lement name= w DatalO n minOcscure^O^ 
<e!ement name= rt Storage M minOccurs^O^ 
<e!ement name= n SupportingTooP minOccurs= M 0 H /> 
</sequence> 
</camplexType> 



Figure 4: Layer 2.1 Structure of Terminal Capability for DeviceProperty 
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1 



5.5 



<complexTypo name^CodecCapabilttiesType^ 
<sequence> 

<eiement name= w AVDecoding u typ8="AVDecodingCapabilitIesType" minOccurs^CT^ 
<e!ement name=-AVEncoding a type^AVEnccd^ngCapabiGtiesType 1, minOccurs^ n 0 a /> 
<element name="lmageFormaf ' minOccur8="0"/> 
<etement name=TextFormar minOccurs=°07> 

olement rame^SystemFormat" types" SystemFormatType" minOccurs="0 n /> 
</sequence> 
</complexType> 



Figure 5: Layer 2.2 Structure of Terminal Capability for Codec 



<comp!exType name^lnputOutputCapablfitiesType^ 
<sequence> 

<element name^AudiolnOuf minOccurs="07> 
<element name= M VideolnOut" mirlOccurs= ,, 07> 
<eiement name='TextlnOuf minQccurs^*07> 
<Ssequence> 
</complexType> 



Figure 6: Layer 2,3 Structure of Terminal Capability for InputOu tput 
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<complexType name="AVDecodtagCapabi]aiesType , '> 
<sequence> 

<e!ement name=Tormat" type= tt mpeg7:ControlledTermUseType"/> 
olement name^n/ldeo" mInOccurs="Cr> 
<complexType> 
<sequence> 

olement name="BufferSlze° type^lnteger" minOccurs= - (T/> 
<element name^BURate 0 minOccurs= ,, O u > 
<complexType> 

<complexContent> 

<extension base^nonNegaUvelntegef"> 

ottribute name^value" type^xsrnonNegatlvelnteger" U3e="required7> 
ottribute names^average" typa="nonNegativelnteger" use="optionaI7> 
ottribute name^maxlmum 0 type^nonNegativeinteger" use="optional'7> 
</extenslon> 
</complexContent> 
</complexType> 
<etement> 
</sequenee> 
</complexType> 
</e!ement> 

olement name= M Audlo^ minOccuf&= w <r> 
<complexType> 
<sequance> 

<element name= M BufferStee M type^nteger" mtnOccurs*"(r/> 
olement name=?BttRate" minOccure^ff 1 * 
<complexType> 

<comptexContent> 

oxtension base^nonNegaHvelntegei^ 

ottribute names*va]ue w type= , 'xs:nonNegativelnteger use="requlre<r/> 
ottribute name= n average a type=^nonNegatIve1nteger use= 0 optional*7> 
ottribute name="maxtmum tt type^onNegativelnteger" use= M optional , 7> 
' </extenslon> 
</comp!exContent> 
</complexType> 
<tfelement> 
</sequence> 
</complexType> 
</element> 
</sequence> 
</complexType> 



Figure 7: Descriptions for AVDecoding under Codec Element 



4 ffiSE# 2003-304690 J 



#2002—300318 




<comptexType name="SystemFormatType°> 
<sequence> 

<etementname= H MPEG2" minOcains="(r> 
eimpleType> 

restriction base^-string^ 

<enumeration va\u9^TS"i> 
enumeration value="PS7> 
</restriction> 
<feimpleType> 
</element> 

<element name^MPEG^ minOccurs="(T> 
<simpleType> 

restriction baso= l, string"> 

enumeration vaIue= w Part17> 
enumeration value=°Part117> 
enumeration vaIue= M Part12 , /> 
<enumeration va!ue="Part137> 
enumeration va!ue= w Part147> 
<enumeration va!ue= a Part157> 
enumeration value= f, Part16'7> 
</restriction> 
</simpieType> 
</element> 

element name="SystemFF' mfnOccurss^O^ 
<8impleType> 

restriction base= n string"> 

enumeration vatue= a MP47> 
enumeration va!ue= M MP27> 
enumeration value- n MP217> 
enumeration vahie^QuickTime7> 
<enumeration value="ASP/> 
enumeration value-" AVi7> 
</restriction> 
<feimpleType> 
</element> 

element name= u CommunicatIonProtocor minOccurs=°a a > 
eimpleType> 

restriction base= w string"> 

enumeration value="RTP7> 
enumeration va!ue=°H.3237> 
enumeration value="HTTP7> 
enumeration vatue="TCP/IP7> 
enumeration value-'SIP"^ 
</restriction> 
</simpleType> 
</element> 
</sequence> 
</comp!exType> 

Figure 8: Descriptions for SystemFormat under Codec Element 
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6. ABSTRACT 



The present invention is related to Digital Item Adaptation (DIA) , where 
a well-described terminal is able to access and consume any content in 
different formats by providing a tree-structure Description for the term 
inal. 



The tree-structure terminal descriptions cover General Property, DatalO, 
Storage, Support ingTool , AVDecoding/Encoding, ImageFormat, TextFormat, 
SystemFormat , as well as AV Input/Output in an organized approach for be 
tter and efficient negotiation on the Terminal capability. 
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2054041301 
^14^12^130 

#M2002-300318 
000005821 

100062144 
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mm&i mmm 

-jR»«sWttJCB5UTCPU, OS, j*^y, m±i. VM ( 

USB, :7>- h^-^ (BlueTooth), rj-f "V V* 8 0 2 (Wir 
eless802), >>'J7^ A 9 WH*©5*-* AfflTJ (I/O) ftjWKf 

•^/I/^jlf 2 * y#- K (MMC) , a^/t* h79y S'a (SftftflO , #SE 
(Secure Disk:SD)), jl^E'J -^f^f fi' (MS), /\- K^-f * 
? (HD) ,• DVD, VCD, Z i pf^^, ^l/Jr^^f'fX^f © 

^n-A;V • 3K2?S/a— >^ • J/^fA (GPS) , ^tflf (Browser) , 
^I^jM^^a^tJf^^-;!/ (IPMP tools) , REL7^ (Rights Express 
ion Language Tool) , ;* -J^Wtf-TJ 

ffi^^fc^SSbTv^ffije©^;* h-tf-tf-^ ytfiz'&^x 

*5ft«:*3M- softer. 
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a°- ^ ^ e> (D n >-r >y#*fr©i& iciirffiSB^fiaaicK-rs u r l &sv** 

7 7 1> - A - ? £ HIS i" -5 £ , 

T^§nfeURL^^#fet5ia^cDia^^^^-tSfeibK:^-^&^ > r 

t&iau r l &t&iass5fc<z>8Bj*«:#£ fc#>&c * =r s/x- */ a y * ? ± - v 
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tiriasHWs nit n y^ y v &ttB«*K:«» , r §ii t 

[ft^3 J |SffB3S5ft(3DiB^C^SURLS:^bTflSOA— 5 s - -f 

«5ttf)J|&S> 3»R3ftfe:/9 *JS/x-J/a>^yfe-S? 
&t*t3—t4 yy-y-tf—f-j y>f?*-^v V zffl&t.* 
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MttzLyn-^j yWiS-'rJ y7?it-~?v b*tWRt*&LM£* 
Jrziyn-'rj y VmWv b y- b*&to2>Mn£. 

#f$G>&X\£v b 1/— b S^ftSSIt, 

~°$Wdv b I/— bto^—rJ ytf(bWr&K&^X, Jr—rJ ^r^yn-v £ 4 y 
tfft<D¥-i%¥y b U— b £&#>5M3I^ 

<D¥i% ¥ v b\s - h £ & & £ t > 

csi#«7] mjeflRflsjc^ne-r-smjecDS/^^A^^-w Messrs 

CH^8] |tfiaMPEG2$/^xA7*-v^ hifjK-- t4 y?*M$l 
MPEG2h7>7s3X-bi/7sfA (TS) 7 # -TV MfaK— r-f > ^Sfc 
MPEG2^D^5Ai/^fA (PS) 7*-T»; hfjK-f -f 
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MP EG4 b 1 ©7#-7»; b-tf-JK—f'-f £&&Si&3S£:* 

MP E G 4 i/XfA^- Ml 07*-?y bifstf-T^ 

MPEG4 b 1 V? biJ^-'r -f > ^5:&#>£i©3ii: 

MP E G 4 i'^fA^- b 1 4©7*-7y hifTK-f 1 W > y&&#)5Si3I £ 
MPEG4 S/T^A/I- b 1 5(D7*-7y b^sK— ^-f > ^Sr^fc-Sittfii: 

* 

MP E G4 ^XrAA- b 1 6 07*-7»; bif-Jtf-'T'f > y&&#>Si&3S£ 

QuickTime 77^f/b7*-T*; b * # — t* -f > ^ £&#>S5©3M£, 

AV i77>f^7*-7*; b^sK— 5 s * -f 

MP 277^f^7#-T*; b-fraK-^-f :^£&#)<5ira£:, 

MP 2 l yyAfr-p-fi-^v ht^-f-f >7*&^«)Sjiii:, 

AS F77'f^7*-7y bU-Jtf-^-f V^*:«fetf>SSfte*:* 
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H. 3 2 3 zfu hn^-f^f >^£&#>£jigh, 
s I P^n ha/Hftf-^-f >^&*«>*5*gi:, 
H T T P rf n h n A/ V- - -r -f > ^ & & &> £ M M £ . 

[0 0 0 1] 

Digital Item Adaptation : D I A) {CWf£o ##§H£&> &<IB$£3;tV 

# ;i/ r 4 t- hs mm izm? & . 

[0 0 0 2] 
[0 0 0 3] 

■e®*S*, #^*r<5 3>^>^lC«, MPEG1, MPEG2, MPEG4, 
DV, DVCPRO, RTP, MP4> QuickTime, AVi, ASFf 

Vm^ZftT^Zo m*.&* 86#<3DDTV STB YVv"?iRv 9 X) It 

, MP EG 2 3>f>y ^itfeMP E G 2 W^5:f 3 - Kti, #£*T?£ 

^y^T-^>^7*-7^ b#M&5©T*, DV J f>MPEG4 3>f> % y«S4 
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[0 0 0 4] 
[0 0 0 5] . 

# £ - # 7 # - T v h © n > y v & ifi* T* T* * & v £ IB 

[0 0 0 6] 

1^1 X\t. MPEG-2 MPiMLa^^-^^^modulel.KDDevice A;fr£>:i — if IC|| 

f|fi(Dmodulel.2, l.3.%.m.5<Dm^Xte : £<D^y'ryy £:g£T*£&V^ 
[0 0 0 7] 

BUT*!*, MPEG-2 MP@MLn>^> % y^module2.1©Multimedia server#»£>:i 
-iflC-f 2 #&T?J§#S3 *l, module2.40DTV STBT*tf>&??£ «T 

fg-e&SZl^&^LTV^,, f[&COmodule2.2, 2.3,^tt^2.5(?)^7K v ??^ j e©n>'r 

[0 0 0 8] 

iz x & b X 3. £ # t> £ c 

[0 0 0 9] 
[0 0 10] 

[0 0 11] 
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mm b «fc e> t -r z> mm 
imm\%* &r<Dmm*Mm'tz>z.iL*E&!£hx^z> 0 

[0 0 12] 

x - 5/ a > T* 3 > t- > y £ jOTfc 7t-7*;h T?Sg5^tC^i- 5 £ £ #T* S § . 
[0 0 13] 
[M * #> ©#&] 

[0 0 14] 

**ey, #^i/-"x--f >^^^^A^$:MB!febTiB«E'e#Sc -ecaiaM&m 

[0 0 15] 
[0 0 16] 
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[0017]. 

u -#itT* e> * < ia^-e# So 

Hi M^te, DeviceProperty, Codec. InputOutput^fM^ tlS. 

1) DevicepropertyCDTlCte, Generalproperty (C P U, OS O^l/ — -5^ 
>^i/^fW > Memory, Power, VM) , DatalO (Serial, Parallel, USB 
, InfraRed, BlueTooth, Wireless802) , Storage (MMC (7;bf^f-f7* 
-K) , SD (iff-f^i') . MS (^^UXf-fy^) , HD (A- Rt^ 
*?) , DVD -RAM, CD-RW, Floppy (gftffiflQ , Zip Disk) , Supp 
ortingTool (>fU - AfytfV ''*/ 3 — > (Global Positioning System 

• GPS) , -fyW (Browser) , IPMP Tool, REL Tool, ^) jtflBjttSil*. 

2) CodecODTlCli, AVDecoding (Audio, Video) , AVEncoding (Audio, Video 

) , ImageFormat, TextFormat, SystemFormat (MPEG-2TS, MPEG-2PS, MPEG-4, M 
P4, ASF, Avi, QuickTime, RTP, H.323, ^) #1B*l3;ft5'o 

3) InputOutputCDTlCli, AudioInOut (Speaker, Mic) , VideoInOut (Display 
, CCD) , TextlnOut (Screen, Point ingDevice, KeyPad, Keyboard) #fafc&£*l 

So 

[0 0 18] 

&C, DeviceProperty3.1> Codec3.2, Input0utput3.3£> 3 -D(£)>f)l> — £>&5 
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[0 0 19] 







mm 


X tiT IIllll cii \s dp cUJJ 1 1, 


J-/ t?V XT up tsr i»y 


SS*co^*4#tt. DatalOv 


ty 




Storage , jSlO'i^W*: 
SupportingTool £rHEi£"t~£o 




Codec 


**<0AV=«— 5*W ^^fiB^J. 




InputOutput 






Extension 


So 



[0 0 2 0] 

o 

[0 0 2 1] 

3^<£>DevicePropertyGDT£>:n U>;* > h©|SM 

EI4 iC^Eg^StlTVNSJ:^^. U>f -Y&> GeneralProperty4.1 % Data 
104.2, Storage4.3, SupportingTooU^&^A^ V^, 
[0 0 2 2] 

IW> b^tJ f -eCD^I*»^-^2lC^bfeo 
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[*2] 









DeviceProperty 


GeneralProperty 


CPU, OS, Memory, Power, VM 




DatalO 


InfraRed^ USB > BlueTooth > 
Serial ^ Parallel Wireless802 
m<0 Data I/O £fB3£i-£o 




Storage 


MMC, SD, MS, HD, DVD, 
VCD, Zip, Floppy ^£>1^~ h 




SupportaigTool 


GPS, Browser, IPMPTool, 
REUIbol, MetadataTool ^<£>Sgi 




Extension 


\ <5„ 



[0 0 2 3] 
5|g7k<DCodec<DTtf>xl/;*> hOffiak 

gf5 &C®&^£^bTV^ J:^JC, Z.O^^^f 1 ^ AVDecoding5.1 > AVEncodin 
g5.2, ImageFormat5.3, TextFormat5 . 4, SystemForraat5.5, Sr^/w^V^,, 

[0 0 2 4] 

X V * > h fttf*©5ftl*tt3l 3 KB b feo 
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»3] 









Codec 


AVDecoding 


Audio j&X* Video Of**— b LXV^ 
*o 




AVEncoding 


Audio .RD* Video (D^tf— h LTV* 

So 




ImageFormat 


h l/TV^S Image V 




TextFormat 


h LTV^ Text format £|E 




SystemFormat 


f-jtf— h LTV*3 System format & 




Extension 


ft m<D$S&i&.m<n irgl-r So 



[0 0 2 5] 

^3fc(Z>Input0utput<Z>T<Z>X > h (Z)S3«I 

0 6 &C|&M#^£*ITV^ <i:e>&C, d©:7*^>^», Audiolnput0utput6.1. V 
ideolnput0utput6.2> Textlnput0utput6.3£-^tfo 
[0 0 2 6] 



ffiSE^ 2003-304690S 



#2 002 — 300318 







mm 


InputOutput 


AudioInOut 


Speaker,Mic *"AtfJ;&1B 




"VideoInOut 


Display.CCD U * y^<Wr*A\&ti 




TextlnOut 


Screen,Pointing,KeyPad,Keyboard , 
Mouse m<DT*X h Atfi^fgjft&iSafc 




Extension 





[0 0 2 7] 

^©DeviceProperty, InputOutput^GCgS-f SSBMttd d v e&§£BJ!%iBK£ : & L 
[0 0 2 8] 

.Codecs i/ ^ y \> ic Hi- 3 IHxE 

^KDCodecxl/;* > AVDecoding, AVEncoding. ImageFormat, TextFormat 

^.tJJSystemFormat^ ^> § o 
[0 0 2 9] 

©7&. $ e,lCAVDecodingO)^EilS.^-eCD-y-^xl/^ > h ?:^bTV%S 0 X U 

* y h £ £ ■£ ©^ufctt^ 5 izB b T v% § o 
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[*5] 







AVDecoding 




Format (7. 1) 


Video/Audio ntf>=i — f^^fy*—* h£:fBi£ 






Video (7. 2) 




Audio (7. 3) 


a _ 


BitRateAudio(7. 4) 


bit/s £ LT^S B -L£> tf y M^- h Sr^-fo 


BitRateVideo(7. 4) 




BufferSize(7. 5) 














<Z> fc «?> V?**? a — ^{CffJ 9 ^ X t> 




r i: jWBIMMR^ = — ^ (H 




ypothetical Reference Decoder :HRD) fcoVvTfi 

• 




*MBrc&&.LV\, r ©Video/Audio BufferSizefS 




% prof ile/leveUCjl-g*;**;*:^ y V 7 1M Xi 






Extension 




Audio/Video<D*BitRate*aiU';< 1/ h£>Ttel* 3^0H4^t5 0 


Value 


-^OtT^KV-f (jftSflK) (S^K&ttSBit 




RatefclI|-t-5ffl?£4ii£r^H\ 


Maximum 






itRatefc|i*t-e S^iitSr^i-o 


Avorago 


TOtfy b b (t^3 >0 <E>#£-fc:*5tt5B 




itRatefiH-t-S 


[0 0 3 0] 




AVEncoding09fB)£ 





miE#2 003 -3 046905 



4#2 002 — 300318 



Z. (JDAVEncoding&, ^ 7 &£J^ 5 IC^kS tlT V 1 * S AVDecodingi: fpff — T? & & = 
[0 0 3 1] 
ImageFormatCDlS^ 

£*U±$g5fc^1f3j<- h UTV^SJPEG, JPEG2000, Gif, Taga, BitMap, PNG, TI 

[0 0 3 2] 
TextFormat©|a^E 

rtltt, Sg5|5T?*3K-h ASCII, Shift-JIS, HTML, XML, SMIL^tf)^;* h V 

[0 0 3 3] 

SystemFormat©SH«& 

0 8&, SystemFormat<D^E^^Lt) I '?-©-9-^niV^> MCoVnT^LTVa5 0 

[0 0 3 4] 



1 5 



2 0 0 3 -3 0 4 6 9 0 ; 



2 0 0 2-3 0 0 3.1 8 







mm 


SystenaFormat 












MPEC2 


TS 


1r>K— hSfbTV^MPKE Transport Multi/di-mult 


(8 1) 

\o. X/ 








P S 


iratf— h $tbTV>5MPEG2 Program Multi/di-multip 






lex4'lB3i£'t"'5 o 


tar Hut 


Parti 

M OX VI 


MPEG4 PartlSCS<5V^Ti^5K"- hc?*^TV , '5MPEG4'> 










Parti 1 

J OX VI X 


MPEG4 PartlltC^-^V^f h ^ttTV^5MPEG4V 










Partl2 

X OX wXX* 


MPEG4 Partl2{cS<5V^"C^2K— h $*LTV*5MPEG4i' 










Partl3 


MPEG4 Partl3tC^-^V^-C^3}?^- h$tlTV>SMPEG4^ 










Partl4 


MPEG4 Partl4{cS<5^ N T^2jf— h$tbTV>SMPEG4i/ 










PartlS 


MPEG4 Partl5lC^<3V^X1?-3^— h$tlXV , *SMPEG4v / 










Partl6 


MPEG4 Partl6lcS<5V^T-9-2K— h £*VCV>5MPEG4^ 








oystcuirr 


MP4 

all *x 


■frsj?— h&jh,TV^5MP4:7 7^/i':7;a-' — h2r!ffi& 










QuickTime 

q{Ul vni AlHv 












ASF 












MP2 


IttK— h$tt"CV^MP27T-Y/^4-^^y h^rSJfe 






7 <w o 




1IP21 












AVi 










Communicati 


RTP 


•^df— ^$4^-CV^§RTP7 p a ha^Sr^iB-fSo 


onProtocol ( 






8, 4) 








H.323 


U-JJ?— h 323^P h =»^Sr|B^i-*. 




HTTP 


■9"^— h^^-CV^HTTP^n h =i/USr|25gi-5. 




TCP/IP 


irjtf— h $4x-CV>STCP/Ipyn h =J^4-|E^i-5o 




SIP 




Extension 






[0 0 3 5] 
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[0 0 3 6] 
[0 0 3 7] 

[0®tfm#£fiBJ!] 

[01] mte&mMoM*Z%irZ^-V\z-xmT*<DnyTyy$:mm 

Ir&ftftWM 1 &*vt0T*&&o 

[®2] M^^a^cD^&^-ts^-iffcm^i^^^n^^^^&n^ 
0-e&<s o . 

[04 ] ag^iaMiCfe^-SDevicePropertytCgg^SSE^S.^^ 0 

[0 5] «^SB^tcS^S Codecs glf S«^t>'^«:Bi"01?feS o 
[0 6] ^|B^C^W<SInputOutputlc58^SHE^t> , #^:Sr^ > r0T* 

[0 7] ^iax£tC £ -5 fC AVDecodinglC 5 £ ^i*0T* 
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1] 



1.1 



(MPEG-2 MP® ML 



lEfi 



MPEG-4 Simple 



MPEG-4 Core 
©PDA 



OK 



MPEG-2 MP® ML 
CDDTV STB 



WMTOPC 



A. 2 



A. 3 



A A 



.1.5 



[02] 



2.1 

i_ 



(MPEG-2 MP® ML 



4— 










-> 


<— 










-> 


«<— 










-> 


<— 




-> 



MPEG-4 Simple 



.2.1 



MPEG-4 Core ^ 22 
©PDA ^ 



MPEG-2 2MP@HL 
<DDTV STB 



~2.3 



WMT<DPC 



2.4 
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<complexType name= tt TerminaJCapabnitiesType"> 
<sequence> 

<element name= tt DeviceProperty ,, type="DevIcaPropertyType° minOccurs-'CT^ 
<element name^Codec? type="CodecCapabirrtiesType" minOccurs= M 0 n /> 
<e!ement name= t, lnputOutput n type^lnputOutputCapabilltlesType" minOccurB="0 a /> 
</sequence> 
</complexType> 



[H4] 




<comptexType name=s"DevlcePropertyType t, > 
<sequence> 

<element name^GeneralProperty" minOccurs= a 07> 
<elernent name= M DatalO" minOccurs="0'7* 
<element name^Storage" minOccurs^O"^ 
<element name="SupportingToor minOccurs="07> 
</sequence> 
<fcomplexType> 
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[05] 




<complexType name^CodecCapabfliliesTyp©'^ 
<sequence> 

<element name=*AVDecoding a type="AVDecocfingCapabilitiesType w minOccurs="07> 
<olement name^AVEncoding^ type^AVEncodingCapabintiesType" minOccurs= H 07> 
<element name= a imageFormat° minOccurss tt 0 l 7* 
<element name^'TextFormaf minOccurs«"0*/> 

<e!ement name^SystemFormat' type^SystemFormatTyp©" mlnOccurs="Cr/> 
</sequence> 
</compiexType> 



[06] 




<compfaxType name= a lnputOutputCapabilitiesType 0 > 
<sequence> 

<element name= u Aud iol nO uf mlnOccurs^O^ 
<element name^VideolnOuf mlnOccurs^O-/^ 
<etementname= tt TextlnOuf mbiOccurs= a 0°/> 
</sequence> 
<fcomplexType> 
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<compJexType name="AVDecodingCapabiI"rtiesType"> 
<sequence> 

<«Jement name= H Formaf type="mpeg7:Control!edTermUseTyp8 ,, /> 
<element name="VWeo" minOocurss=V> 
<complexType> 
<sequence> 

<eJement name=*"BufferSlze n type="fnteger" minOccurs^*<n> 
olement name^BitRate" mInOccurs= B 0 tt > 
<comp!exType> 

<complexContent> 

^extension base=^nonNegatlvelnteger> 

ottribute name= n value" type= w xs:nonNegativelnteger n uae^required^ 
ottribute name^average" type^nonNegativelnteger use= a optionar7> 
ottribute name^maximum" type^nonNegativelntegeT use^optionar7> 
</extenslon> 
</complexContent> 
</comp!exType> 
<element> 
</sequence> 
</complexType> 
</element> 

<e!ement name= w Audlo w mlnOocurs= u cr> 
<complexType> 
<sequence> 

olement name^BufferSIze" type^tnteger m$nOccurs=^(r/> 
olement name^BHRate'* mlnOccufS=s n 0 M > 
<complexType> 

<complexContent> 

<extension base="nonNegative!nteger ,, > 

<attribute name="value M type="xs:nonNegativetnteger" use="require<r7> 
ottribute name="average rt type^nonNegatlvelnteger" use=^*optJonar7> 
ottribute name="maximum 0 lype^nonNegativelntegei" use=^optionar7> 
' </extens!on> 
</complexContent> 
</complexType> 
</element> 
<sequence> 
</complexType> 
</elemeht> 
</sequence> 
</complexType> 
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<complexType name= ,, SystemFormatType a > 
<sequence> 

element name^MPEGa" minOccurs="(r> 
<simpleType> 

restriction base*"strinp^> 

enumeration value=TS7> 
enumeration value="PS7> 
<tfrestriction> 
<feimpleType> 
</element> 

<e1ement name=*"MPEG4" minOccurs="0"> 
<simpleType> 

restriction base="string"> 

enumeration vaiue="Part17> 
enumeration vaIue=5"Part117> 
<enumeration value= w Part127> 
<enumeration vaJue^Partiy^ 
enumeration value= n Part147> 
<enumeration value= a Part157> 
enumeration vatue=s l, Part16 ,, /> 
</restrictio n> 
</stmpleType> 
</element> 

element name= M SystemFF* mfnOccurs^O . 
<8impIeType> 

restriction base= n string ,, > 

enumeration value^MP^/i* 
enumeration value= M MP2°/i> 
<enumeration value= w MP217> 
<enumeration vaiue="QuiekTime7> 
enumeration value="ASP/> 
enumeration vatue= B AVT/> 
</restriotion> 
</simpteType> 
</element> 

element name=XomrnunicationProtocol M minOccurs= 0 Cy> 
eimpleType> 

restriction base^'strino^ 

enumeration value="RTP7> 
enumeration value=°H.3237> 
enumeration value="HTTP7> 
enumeration vaiue="TCP/IP7> 
enumeration value^'SIP"/* 
</restriction> 
</simpleType> 
</element> 
</sequence> 
</comp(exType> 
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